Reinforcement learning in populations of spiking neurons

Population coding is widely regarded as a key mechanism for achieving reliable behavioral responses in the face of neuronal variability. But in standard reinforcement learning a flip-side becomes apparent. Learning slows down with increasing population size since the global reinforcement becomes less and less related to the performance of any single neuron. We show that, in contrast, learning speeds up with increasing population size if feedback about the populationresponse modulates synaptic plasticity in addition to global reinforcement. The two feedback signals (reinforcement and population-response signal) can be encoded by ambient neurotransmitter concentrations which vary slowly, yielding a fully online plasticity rule where the learning of a stimulus is interleaved with the processing of the subsequent one. The assumption of a single additional feedback mechanism therefore reconciles biological plausibility with efficient learning

Synchronized dynamics of cortical neurons with time-delay feedback

The dynamics of three mutually coupled cortical neurons with time delays in the coupling are explored numerically and analytically. The neurons are coupled in a line, with the middle neuron sending a somewhat stronger projection to the outer neurons than the feedback it receives, to model for instance the relay of a signal from primary to higher cortical areas. For a given coupling architecture, the delays introduce correlations in the time series at the time-scale of the delay. It was found that the middle neuron leads the outer ones by the delay time, while the outer neurons are synchronized with zero lag times. Synchronization is found to be highly dependent on the synaptic time constant, with faster synapses increasing both the degree of synchronization and the firing rate. Analysis shows that presynaptic input during the interspike interval stabilizes the synchronous state, even for arbitrarily weak coupling, and independent of the initial phase. The finding may be of significance to synchronization of large groups of cells in the cortex that are spatially distanced from each other.Comment: 21 pages, 11 figure

Differential Regulation of the Excitability of Prefrontal Cortical Fast-Spiking Interneurons and Pyramidal Neurons by Serotonin and Fluoxetine

Serotonin exerts a powerful influence on neuronal excitability. In this study, we investigated the effects of serotonin on different neuronal populations in prefrontal cortex (PFC), a major area controlling emotion and cognition. Using whole-cell recordings in PFC slices, we found that bath application of 5-HT dose-dependently increased the firing of FS (fast spiking) interneurons, and decreased the firing of pyramidal neurons. The enhancing effect of 5-HT in FS interneurons was mediated by 5-HT2 receptors, while the reducing effect of 5-HT in pyramidal neurons was mediated by 5-HT1 receptors. Fluoxetine, the selective serotonin reuptake inhibitor, also induced a concentration-dependent increase in the excitability of FS interneurons, but had little effect on pyramidal neurons. In rats with chronic fluoxetine treatment, the excitability of FS interneurons was significantly increased, while pyramidal neurons remained unchanged. Fluoxetine injection largely occluded the enhancing effect of 5-HT in FS interneurons, but did not alter the reducing effect of 5-HT in pyramidal neurons. These data suggest that the excitability of PFC interneurons and pyramidal neurons is regulated by exogenous 5-HT in an opposing manner, and FS interneurons are the major target of Fluoxetine. It provides a framework for understanding the action of 5-HT and antidepressants in altering PFC network activity

Postnatal development of A-type and Kv1- and Kv2-mediated potassium channel currents in neocortical pyramidal neurons

Potassium channels regulate numerous aspects of neuronal excitability, and several voltage-gated K+ channel subunits have been identified in pyramidal neurons of rat neocortex. Previous studies have either considered the development of outward current as a whole or divided currents into transient, A-type and persistent, delayed rectifier components but did not differentiate between current components defined by α-subunit type. To facilitate comparisons of studies reporting K+ currents from animals of different ages and to understand the functional roles of specific current components, we characterized the postnatal development of identified Kv channel-mediated currents in pyramidal neurons from layers II/III from rat somatosensory cortex. Both the persistent/slowly inactivating and transient components of the total K+ current increased in density with postnatal age. We used specific pharmacological agents to test the relative contributions of putative Kv1- and Kv2-mediated currents (100 nM α-dendrotoxin and 600 nM stromatoxin, respectively). A combination of voltage protocol, pharmacology, and curve fitting was used to isolate the rapidly inactivating A-type current. We found that the density of all identified current components increased with postnatal age, approaching a plateau at 3–5 wk. We found no significant changes in the relative proportions or kinetics of any component between postnatal weeks 1 and 5, except that the activation time constant for A-type current was longer at 1 wk. The putative Kv2-mediated component was the largest at all ages. Immunocytochemistry indicated that protein expression for Kv4.2, Kv4.3, Kv1.4, and Kv2.1 increased between 1 wk and 4–5 wk of age